Skip to content

Add StarRocks shared-data FE/CN support and restore 3.x compatibilityKi shared data upgrade#5

Open
KiBlazer wants to merge 20 commits into
StarRocks:mainfrom
KiBlazer:ki-shared-data-upgrade
Open

Add StarRocks shared-data FE/CN support and restore 3.x compatibilityKi shared data upgrade#5
KiBlazer wants to merge 20 commits into
StarRocks:mainfrom
KiBlazer:ki-shared-data-upgrade

Conversation

@KiBlazer
Copy link
Copy Markdown

Summary

This PR restores stargo for current StarRocks deployment workflows and adds shared-data support.

Main changes:

  • Add CN configuration, deployment, start/stop/display/import support.
  • Add shared-data deployment flow with FE + CN.
  • Add shared-data readiness checks after deploy and CN start.
  • Keep shared-data operations on FE + CN paths instead of BE paths.
  • Preserve user-provided FE/BE/CN data and log directories during import.
  • Add semantic StarRocks version comparison for upgrade/downgrade checks.
  • Add JDK 17 support, build scripts, CI, validation docs, and focused tests.

Validation

Local checks on the official repository branch:

  • go test ./...
  • go build ./...
  • go vet ./...
  • test -z "$(gofmt -l .)"

Manual Multipass validation:

  • StarRocks 4.0.0 shared-data, 1FE + 1CN + MinIO: PASS
  • StarRocks 4.0.0 shared-data, 3FE + 2CN + MinIO: PASS
  • StarRocks 3.5.15 shared-nothing, 1FE + 1BE: PASS

Manual scenarios covered:

  • display
  • SQL CRUD
  • role-level stop/start
  • import
  • shared-data readiness
  • CN offline failure propagation
  • MinIO unavailable readiness failure
  • same-version upgrade/downgrade rejection

Known limits

  • Default CI does not start real StarRocks processes.
  • CentOS packages are compatibility targets but not yet manually validated.
  • latest 4.x stable beyond 4.0.0 is not yet manually validated.
  • Real cross-version upgrade was not executed; this PR validates shared-data path boundaries and same-version rejection.
  • import is strict: if a configured node is unreachable, import fails instead of producing partial metadata.
  • shared-data cold start or node recovery may require longer tablet creation time; StarRocks may need tablet_create_timeout_second adjusted for slow environments.

KiBlazer and others added 20 commits April 20, 2026 22:09
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
Signed-off-by: kingbo <kingbo1587@163.com>
@KiBlazer KiBlazer force-pushed the ki-shared-data-upgrade branch from d5e0a63 to f05445a Compare April 20, 2026 14:09
@CLAassistant
Copy link
Copy Markdown

CLAassistant commented Apr 20, 2026

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants